System, platform and method for personalized shopping using an automated shopping assistant

ABSTRACT

There is provided, in accordance with an embodiment of the present invention, an apparatus, system, and method to provide personalized online product fitting, according to some embodiments. One embodiment of the invention includes a method for personalized shopping has the steps of an automated shopping assistant system accessing product data, a matchmaking system accessing user history data, the matchmaking system accessing user preference data, the matchmaking system accessing user anatomical data acquired from an automated shopping assistant apparatus, the automated shopping assistant system matching user history, preference and anatomical data with data to generate a personalized matching system.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a U.S. National Stage application under 35 U.S.C. §371 of the International Application PCT/US2018/039781 (published as WO2019/005986 A1), filed Jun. 27, 2018, which claims priority to U.S.Provisional Application No. 62/525,454, filed Jun. 27, 2017, entitled“SYSTEM, PLATFORM AND METHOD FOR PERSONALIZED SHOPPING USING ANAUTOMATED SHOPPING ASSISTANT” the disclosures of which are herebyincorporated by reference in their entirety.

FIELD OF THE INVENTION

The present invention relates in general to methods, applications, anddevices useful in personalized product shopping.

BACKGROUND OF THE INVENTION

A great majority of shoe shopping today still takes place in real bricksand mortar shops. Most customers are familiar with the limitations ofconventional shopping, as are the shop managers and assistants. Ingeneral, customers are dependent on shopping assistants, to direct themtowards products, location of in-stock products, assistance on trying onproducts etc.

Further, the typical shopping experience needs to repeated withsubstantially each visit of a customer to the same or a different shop,leading to great inefficiency and user frustration.

It would be highly advantageous to have a system or method that couldallow highly accurate and user-friendly automated or semi-automatedfitting solutions, both online and in store.

SUMMARY OF THE INVENTION

There is provided, in accordance with an embodiment of the presentinvention, an apparatus, system, and method to provide personalizedonline product fitting, according to some embodiments.

One embodiment of the invention includes a method for personalizedshopping has the steps of an automated shopping assistant systemaccessing product data, a matchmaking system accessing user historydata, the matchmaking system accessing user preference data, thematchmaking system accessing user anatomical data acquired from anautomated shopping assistant apparatus, the automated shopping assistantsystem matching user history, preference and anatomical data with datato generate a personalized matching system.

In some embodiments, the automated shopping assistant system matchesuser history and preference data with product data, to generatepersonalized product recommendations.

In some embodiments, the automated shopping assistant system may be usedto allow the user to order personalized products.

In some embodiments, the automated shopping assistant system may be usedto providing a simulation that represents one or more anatomicalcharacteristics of the user.

In an embodiment, the user and one or more third parties may provideproduct fitting feedback, and the user and one or more third parties mayprovide social feedback. The automated shopping assistant system mayadjust the personalized product based on the product feedback. Thesystem may also provide anatomical data about a user, wherein theautomated shopping assistant system also considers the anatomical datato generate a user shopping avatar that contains one or morecharacteristics of the user.

In many embodiments, the automated shopping assistant system may includea virtual try-on feature. In an embodiment, before the user orders thepersonalized product, the product is generated based on the avatar. Theuser preferences may be selected from the group consisting of size,color, material, and type preferences.

According to sonic embodiments, a platform is provided for personalizedshopping, including a cloud based server including a profile module forgenerating a digital avatar for multiple users, a product module forconsolidating product data for multiple products, and a matchmakingmodule adapted to run code to match the digital avatar data and theproduct data, to generate product recommendations; an end user computingdevice, communicatively connected to the cloud based server, includingan image capture element, wherein the matchmaking module runs a softwareapplication to generate a user mobile shopping avatar based on thecapture of at least a part of the user anatomy, to be used in generatinganatomical data for the digital avatar profile for a user.

In some embodiments, the platform is adapted to generate and/or presenta simulation that represents one or more anatomical characteristics ofthe user.

In some embodiments, the platform may have a product ordering module, aproduct customization module, a social shopping module, and/or a productfitting module etc.

In another embodiment, a handheld system for personalized shopping mayhave a screen configured to receive a user's input, a device camera tocapture standard images of a user anatomy, and a processor havingregisters adapted to analyze anatomical data, product data, user historydata and user preference data, wherein the processor retrievesinformation from the registers, and writes information to the registers,is configured to match user history and preference data with productdata to generate a personalized matching system, and the processor isconfigured to match user history and preference data with product data,to generate a personalized product, and wherein the user may purchasethe personalized product by providing user input to the screen.

In one embodiment, the system has a depth sensor configured toaccurately determine the distance of a subject from the sensor, andwherein depth sensor information is used to match preference data withproduct data. In some embodiments, the depth sensor is capable toprovide a 3D scan of at least a part of a body that relates to ananatomical profile of a user, to allow capture of length, breadth, anddepth of the part of the body.

In some embodiments, the handheld system includes a software applicationrunning on the handheld system, to generate and present a graphicsimulation of a user mobile shopping profile based on the capture of atleast a part of the user anatomy.

In yet another embodiment, A shopping assistant system for shoppingusing a shopping profile is provided, including a shopping assistantstanding surface, for generating a 3D user shopping profile based on acapture of at least a part of a user's body by a camera device; a mobiledevice app for applying the user shopping profile in a store; a shoppingassistant server connected to a shopping assistant database, based in acommunications cloud; and multiple products tags for al lowing the userto capture selected products.

In many embodiments, the shopping assistant system further includes oneor more image scanners for capturing at least a part of a body thatrelates to an anatomical profile of a user, to allow capture of length,breadth, and depth of the part of the body.

In many embodiments, the shopping assistant standing surface includesone or more markings for assisting the capturing of body partdimensions.

In many embodiments, the shopping assistant standing surface includesone or more markings 3D elements for assisting the positioning of a bodypart to be scanned.

In many embodiments, the shopping assistant standing surface includesone or more pressure sensors for capturing a depth impression of atleast a part of a body that relates to an anatomical profile of a user.

In many embodiments, the shopping assistant system includes an apparatussupporting one or more light sources for capturing a depth impression ofat least a part of a body that relates to an anatomical profile of auser.

In many embodiments, the shopping assistant system further includesmultiple product tags associated with multiple products, for a user toshop by scanning one or more product tags.

In many embodiments, the shopping assistant system further includes aproximity sensor associated with the shopping assistant apparatus, foridentifying a user when the user enters a selected geographical zonearound the shopping assistant apparatus.

In many embodiments, the shopping assistant system further includes ashopping profile for each of a plurality of users, for allowing a mobiledevice user shop for another user using the other user's shoppingprofile.

Still another embodiment of the invention includes a method for in-storeshopping enhancement is provided, including identifying a user enteringa shopping area, using a proximity sensor associated with a shoppingassistant standing surface; positioning the user on the shoppingassistant standing surface; opening a new or known user profile;initiating capture of at least a part of a body using one or moresensors; generating a user 3D shopping profile of the user; sending theuser shopping profile to the user mobile device, where it is usable in ashopping assistant application; selecting a product of interest by theuser, by scanning a product tab using the user mobile device; andproviding the user with shopping assistance for the selected product.

In a variety of embodiments, the method further includes ordering aselected product using the user mobile device.

In a variety of embodiments, the method further includes customizing aselected product using the user mobile device.

In a variety of embodiments, the method further includes ordering acustomized product using the user mobile device.

In a variety of embodiments, the method further includes providing theuser product inventory information.

In a variety of embodiments, the method further includes fitting theselected product on the user shopping profile avatar.

In a variety of embodiments, the method further includes sending thefitted user profile avatar to a social media system for viewing byselected associated connected to the user.

In a variety of embodiments, the method of claim 10 further includesenhancing the user shopping profile based on the user behavior.

In a variety of embodiments, the method, further includes providingshopping recommendations based on the user shopping profile and/or usershopping behavior.

In a variety of embodiments, the method further includes using the usershopping profile for shopping in an online store.

In a variety of embodiments, the method further includes enhancing theuser shopping profile using one or more capturing elements selected fromthe group consisting of a pressure sensor, image sensor, laser, andlight sensor.

In a variety of embodiments, the method further includes addingadditional user shopping profiles to a mobile device.

In a variety of embodiments, the method further includes converting auser's profile from an in-store apparatus to a user mobile device.

BRIEF DESCRIPTION OF THE DRAWINGS

The principles and operation of the system, apparatus, and methodaccording to the present invention may be better understood withreference to the drawings, and the following description, it beingunderstood that these drawings are given for illustrative purposes onlyand are not meant to be limiting, wherein:

FIG. 1A is a schematic system diagram depicting a system forfacilitating personalized shopping, according to some embodiments;

FIG. 1B is a schematic system diagram depicting a platform forfacilitating personalized shopping, according to some embodiments;

FIG. 2 is a flow diagram indicating a process of facilitatingpersonalized shopping, according to some embodiments;

FIG. 3 is a flow diagram for facilitating a personalized in-storeshopping experience, according to some embodiments;

FIG. 4 is a flow diagram for facilitating a personalized online shoppingexperience, according to some embodiments;

FIG. 5 is a flow diagram indicating an example of personalized hybridshopping experience, according to some embodiments; and

FIG. 6 is a flow diagram indicating an example of personalized shoesshopping, online or offline, according to some embodiments;

FIG. 7 is a flow diagram indicating an example of personalized eyewearshopping and manufacturing, online or offline, according to someembodiments;

FIG. 8A shows an exploded view of an example of a shopping assistantapparatus, according to some embodiments;

FIGS. 8B-8H show a set of views of an example of a shopping assistantapparatus, according to some embodiments;

FIG. 9 shows a shopping assistant system, according to some embodiments;

FIG. 10 is a flow diagram indicating an example of integrated usage of ashopping assistant in store apparatus, and a remote user communicationsdevice with a personalized shopping support application, according tosome embodiments;

FIGS. 11A and 11B describe examples of a process of shopping assistantusage, according to some embodiments;

FIGS. 12A-12B are examples of screenshots showing interactive screens onthe shopping assistant screen, for guiding a user to place their feet onthe marked pad, according to some embodiments;

FIGS. 13A-13B are examples of screenshots showing an interactive guideon the shopping assistant screen or mobile screen, for helping the userto define their profile, and their contact information, according tosome embodiments;

FIGS. 14A-14B are examples of screenshots on the shopping assistantscreen or mobile screen, for showing a simulated rendition of a pair ofscanned feet and lower legs, according to some embodiments;

FIGS. 15A-15B are examples of screenshots on the shopping assistantscreen or mobile screen, for assisting a user in entering behaviorrelated information, that may be used to provide better user relatedoutput;

FIGS. 16A-16D show a set of views of an example of a shopping assistantstanding surface, according to some embodiments;

FIG. 17 shows an additional version of a shopping assistant standingsurface, according to some embodiments;

FIG. 18 shows a further version of a shopping assistant standingsurface, according to some embodiments;

FIG. 19 shows a first user case in which a virtual graphic example isprovided showing usage of the shopping assistant apparatus, according tosome embodiments;

FIG. 20 shows a second user case in which a virtual graphic example isprovided showing usage of the shopping assistant apparatus, according tosome embodiments; and

FIG. 21 is a picture showing an example of a user positioned on ashopping assistant apparatus, according to some embodiments.

DETAILED DESCRIPTION OF THE INVENTION

The following description is presented to allow one of ordinary skill inthe art to make and use the invention as provided in the context of aparticular application and its requirements. Various modifications tothe described embodiments will be apparent to those with skill in theart, and the general principles defined herein may be applied to otherembodiments. Therefore, the present invention is not intended to belimited to the particular embodiments shown and described, but is to beaccorded the widest scope consistent with the principles and novelfeatures herein disclosed. In other instances, well-known methods,procedures, and components have not been described in detail so as notto obscure the present invention.

The term “fitting” as used herein refers to trying on a product, seeinga product tried on, modifying the product to a particular person's body,and/or other physical parameters. The term “avatar” refers to anembodiment, personification, icon, model, or figure representing aparticular person, in particular, to represent a person on screen.

The relatively low rate of footwear purchases online shopping may beincreased by providing an accurate size recommendation to the customer,optionally based on a simulation or avatar model of a customer's feet,for each shoe model, leading to higher customer confidence in thepurchase.

Non-limiting embodiments of the present invention include a system,platform, and method for facilitating highly personalized shopping,whether online and/or in-store, including effective fitting-on ofproducts. In some embodiments, systems, platforms, and methods areprovided for allowing personalized manufacturing of product.

Reference is now made to FIG. 1A, which is a schematic system diagramdepicting a system 100 for facilitating personalized shopping, accordingto some embodiments. System 100 allows seamless shopping in store and/oronline, using a highly accurate user shopping profile and/or avatar,generated by an automated shopping assistant apparatus. In some cases,data processing is performed on the cloud and/or on the local automatedshopping assistant apparatus.

As can be seen, personalized shopping system 100 includes a platform 105for personalized shopping profile management, which may include adigital avatar profile module 110, a digital product file module 115, aproduct selection module 120, a product fitting module 125, a socialshopping module 130, a product ordering module 135, and a productcustomization module 137.

Platform 105 is in communication with communications cloud 140, whichmay include physical profile data module 145, communicatively connectedto launch pad, kiosk, or automated shopping assistant apparatus 185,which is further connected communicatively to users 180, providingphysical user data, for example, from 2D and/or 3D scans or otherdigital measurement sources. Communications cloud 140 may furtherinclude user preference data module 150, communicatively connected toautomated shopping assistant apparatus 185, and/or to 180, providinguser preference data. Communications cloud 140 may further includeproduct file data module 160, communicatively connected to productdatabases 165, and product matching data module 170 containing productmatching algorithms, communicatively connected to product databases 175.

In one embodiment, apparatus 185 includes one or more imaging devices,such as 2D and/or 3D cameras, that may be moving or static components.Apparatus 185 may further include one or more sensors, for example, aproximity sensor, scanner, camera, pressure plate, and/or other sensors.

As can be seen, digital avatar profile 110 is highly personalized,constructed from various data sources, whether directly or indirectlyfrom a user, and whether representing physical characteristics and/ormental, emotional, psychological characteristics. Digital avatar profile120 generally includes a file or group of files and data points fromwhich instructions can be executed to allow the generation of ahigh-resolution user profile or avatar from one or more data sources.Further, product selection module 120 generally matches up personalizedavatar profile 110 with selected digital products, whether online oroffline. In some embodiments, one or more device registers may be used,wherein the register(s) refers to one of a small set of data holdingplaces that are part of a computer processor, for holding a computerinstruction, a storage address, or any kind of data. The matchingalgorithm, in some embodiments, may include running code to provideperfect or close to perfect matches between product types, sizes,styles, models, etc. provided by a product database, and the physicalparameters and/or user preference data as defined by the user avatarprofile, based at least on a scan of at least a part of the user's bodythat relates to the user's profile. For example, user A can have a footprofile that is defined by a size, width, and depth. Further, the user'sprofile may include preference data such as preferred styles, shoetypes, models, and colors, such as a blue or grey athletic shoe, Theproduct database may include, for example, an athletic shoe is colorsblue, grey, and blue-grey, in the precise or close enough to the user'ssize, width, and depth. In this case, the matching algorithm will matchthe profile definitions with the one or more products from the productdatabase that match the user profile.

Product selection module 120 may be further refined by providing systemfeedback and product fitting data using product fitting module 125, aswell as social shopping data from social shopping module 130. Productfitting module 125, in some embodiments, includes a means for feedbackfrom a shopping assistant or supporter that is with the shopper. Inother embodiments, product fitting module includes a means for feedbackfrom a virtual shopping assistant or supporter, for example, acommunicatively connected supporter, a digital or virtual mirror orscreen showing the user with the product. Further, product customizationmodule 137 may receive data from product fitting module 125 and/orsocial shopping module 130, to help further personalize the productbeing considered for acquisition in accordance with the digital avatarand the product fitting module 125 and/or social shopping module 130.Product customization module 137 may allow a user to change or customizethe product being tried on or tested, for example, by changing productcolors, shape, design, size, materials etc. In this way, the product tobe ordered may be constructed in accordance with user specific orcustomized requirements. Further, the product customization module 137may send to the product selection module 120 the customized product aschosen or generated by the user, after which the product selectionmodule 120 may initiate the ordering of the customized product, via theproduct ordering module 135. Moreover, user updates embodied in theuser's changes made in product selection module 120 may be used toupdate the digital avatar profile 110, thereby keeping the user avatarprofile updated, for example, to user body changes, preference changes,etc.

Product selection module 120 includes a file or group of files and datapoints from which instructions can be executed to execute commands toallow the matching of high-resolution user profiles or avatars toproducts that have a high level of fit to the shopping research beingperformed by each system user. This module may further integrate thefeedback generated in the system modules to constantly improve theaccurate product recommendation it provides. Using a variety oftechnical procedures that are performed on the avatar, such asintegrating volume, cross section area and circumferences as well aslength, width, height and additional distances, the system may representthe avatar in an array of representing numbers. This array of numbers,in some embodiments, may represent the various elements of the avatar,to allow for comparison to similar elements of the products to be triedon by the avatar. Accordingly, when the avatar data which may beenhanced using recommendation algorithms and machine learning techniquesetc., is compared to the product data from the product file, this mayallow for an accurate, constantly improving, personalized productrecommendation from the system.

According to some embodiment, digital avatar profile can be generatedwith relatively low-level integration of 3D scanners. In some examples,sensors or scanners that may be used may include structured light,time-of-light, photogrammetry, or any other type of 3D and/or 2Dscanning technology. A variety of sensors and scanners, include, but arenot limited to, are PrimeSense based scanners, Occipital StructureSensors, 3D-Systems Sense and iSense sensors, Intel Real Sense sensors(stand alone or machine integrated), scanning platforms provided onmobile devices such as cellular telephones or tablet devices, personalcomputers, etc.

Reference is now made to FIG. 1B, which is a schematic system diagramdepicting a platform 180 for facilitating personalized shopping,according to some embodiments. As can be seen, personalized shoppingplatform 180 includes one or more user mobile devices 182, such assmartphones or tablets, including, without limitation, a camera,application and data connectivity; a shop or point of sale computingdevice, kiosk or automated shopping assistant apparatus 184, typicallyat or near a shop, for example an electronic device with a one or morecameras, sensors or scanning devices, application, and dataconnectivity; where mobile device(s) 182 and or automated shoppingassistant apparatus 185 connect to the communications cloud 186.Communications cloud 186 includes a digital product module 190, forholding, consolidating and otherwise managing data for multipleproducts; a digital avatar profile module 188, for holding,consolidating, processing, and otherwise managing profile data formultiple users; and matching module 192, for matching product and avatarprofile data, to assist in allowing product recommendations and othermatching functions. Platform 180 further includes a productcustomization module 194, for allowing ordering of customized productsbased on matching module output and or user choices; and productordering module 196, for allowing ordering of products based on thebased on matching module output and or user choices.

Reference is now made to FIG. 2 , which is a is a flow diagramindicating a process of facilitating personalized shopping, whetheronline or offline, according to some embodiments. As can be seen,product information from a product database 200 may be used for productsto be discovered, purchased, or manufactured. At step 205 history datafor a user may be retrieved, for example, based upon previous userpurchases and research. At step 210 user preference data may beacquired, such as size, color, material, type preferences etc. At step215, scanned or graphic data may be acquired for a user, for example,from standard photographs, 2D and/or 3D image scanning, or from captureand processing using a POS kiosk or automated shopping assistantapparatus etc. This graphic data is used by the personalized shoppingsystem to generate a user's physical profile based on the user'sphysical properties. At step 220 a multi-dimensional user shoppingprofile, hereinafter referred to as a user shopping avatar, may bedeveloped, by processing the various input data from steps 205, 210 and215, thereby generating a user shopping avatar or profile that includesuser physical properties as well as user behavior and user preferencedata. The profile or avatar is a dynamic structure that may constantlyimprove in the way it animates, reflects, or represents the user,optionally using feedback and additional inputs from steps 205, 210,and/or 215. In one implementation, a user avatar may be used to match auser to potential products, in a single store, and/or in multiplestores, for example, in any retail store in a chain of stores, oronline, in a network or affiliation of online and/or offline stores orplatforms.

At step 225, a matchmaking of the user shopping profile to productsbeing researched or required is executed. At this step, the product datafrom product database 200 is matched to products being researched by auser, in accordance to the specific user shopping profile, therebyallowing advanced filtering out of non-appropriate products for thespecific user, and the advanced matching up of appropriate products, inaccordance with the specific user's personal shopping profile andpreferences. The step of matching may be complemented by a provision ofrecommendations for the user, based on the user profile to productmatchmaking process.

At step 230 product fitting data from feedback of physically presentpersonnel or remote people may be used to help modify the matchmaking ofuser data to product data, for example, the feedback from a salespersonin a store may be used to update the user profile, or the feedback fromremote people connected via a smart phone or computer for example. Insome cases, for example, salesperson or friend feedback, such as whichcolors look good on a person or which size looks best etc. may be usedby the user to update their shopping profile. In some cases, advancedgraphic processing and 3D rendering may be used for the user tovirtually try on the product being researched, such that the users maysee themselves dressed in the product in accordance with a digitalsimulation that places the product onto the user shopping avatar. In avariety of embodiments, a model is dynamically generated based on theproduct fitting data and/or user profile and augmented by modifying thegenerated model to incorporate the model of the product being tried on.This model can then be displayed using any of a variety of devicesdescribed herein, thereby allowing the customer to preview the products.In some cases, the system may provide a static or dynamichigh-resolution visual output such as an animated avatar or character,rendered pictures and/or visual representation of the recommendation,optionally fitted on the avatar. For example, such a rendition may allowthe user to see the product being tried on to be depicted on the avatar,thereby helping the user to visualize details such as fit, tightness,color, style, material, models, etc., according to color heat maps etc.For example, color heat maps may be used to indicate areas of tightness,tension, friction etc. when the product interfaces with the body. Asdescribed herein, the user may use the shopping avatar to providerfurther feedback to modify the user's shopping profile. At step 235feedback may be acquired from social networks or direct third partyfeedback to which a user is connected, to help modify the user shoppingprofile.

At step 237, product customization may integrate data from productfitting feedback at step 230 and/or social feedback at step 235, to helpfurther personalize the product being considered for acquisition inaccordance with the digital avatar and the product fitting module 125and/or social shopping module 130.

At step 240, a personalized product may be ordered by a user, whetherinside a physical store or an online store. Further, a personalizedproduct may be ordered from a manufacturer who may produce a productbased upon the user's request such that the product is a once-offcustomized product for a user. The custom products may include, forexample, various types of customization including material type, printsamples, color, size, volume, angles, model variation, styles, personaltailoring, etc.

Reference is now made to FIG. 3 , which is a flow diagram forfacilitating a personalized offline (in the store) shopping experience,according to some embodiments. As can be seen, at the backend orcomputing system supporting a physical store, product information from aproduct database 300 may be used for products to be discovered,purchased, or manufactured by an online user. In some embodiments,product database is associated with a product data processing module,which is adapted to perform high intensity calculations on the localpoint-of-sale device and/or on the cloud, depending on the embodimenttype and requirements. At step 305 history data for a user may beretrieved, for example, based upon previous user purchases in a store orchain of stores. At step 310 user preference data may be acquired, suchas size, color, material, type preferences etc. At step 315, at thefrontend or user side, scanned or graphic data may be acquired for auser, for example, from standard photographs, 2D and/or 3D imagescanning, or from capture and processing using a POS kiosk or apparatusetc. In some embodiments, a dedicated or generic application on a smartphone, tablet, or other computing device may be used to allow effectivephotographing or scanning of a user. In further embodiments a dedicatedor generic camera or scanning device, kiosk or standing station (movingor static) may be used by a shopping assistant, helper, and/orsalesperson. At step 320, this geometrical data is used by thepersonalized shopping system, together with the various input data fromsteps 305 and 310, to generate a multidimensional user shopping avataror profile that includes user physical properties as well as userbehavior and user preference data.

At step 325, a matchmaking of the user shopping profile to productsbeing researched or required is executed. At this step, the product datafrom product database 300 is matched to products being requested by auser, in accordance to the specific user shopping profile. The step ofmatching may be complemented by a provision of recommendations for theuser, based on the user profile to product matchmaking process, therebyallowing advanced filtering out of non-appropriate products for thespecific user, and the advanced matching up of appropriate products, inaccordance with the specific user's personal shopping profile andpreferences. This advanced filtering allows a shop salesperson, forexample, or the user themselves, to be presented with substantiallyappropriate products, optionally products that are currently available,rather than have the user select items that are non-appropriate, therebywasting time and resources of shopping assistants and the shopperthemselves. This also allows for users to benefit from matching andrecommendation data, which was generated for other avatars or users,which may share similar features, optionally in an anonymized manner,thus allowing a smarter and more accurate matching and/orrecommendations.

At step 330 product fitting data from feedback of physically presentpersonnel or remote people may be used to help modify the matchmaking ofuser data to product data, for example, the feedback from a salespersonin a store may be used to update the user profile, or the feedback fromremote people connected via a smart phone or computer for example. Insome cases, for example, salesperson or friend feedback, such as whichcolors look good on a person, what model of shoes looks best on theperson, and/or which size looks best etc., may be used by the user toupdate their shopping profile. At step 335 feedback may be acquired fromthe users, using an active and/or passive approach. For example, activeentry of feedback may occur when the system receives actual feedbackabout the fit (e.g., good/bad/off by how much) or other aspects, whetherfrom a present person or people and/or a remote person or people. Suchfeedback may allow a user to, for example, enter selected choices intothe system, for example, via a box or text entry element where the usermay enter a selected size, model, type and/or other preference. Passivefeedback may occur when the system receives actual feedback about thefit or other aspects originating from sales information, returns, etc.,or by trying on certain types, colors, models, sizes etc., allowing thesystem to learn from the user's past choices and behavior to furtherimprove the personal avatar as well as the product information and fitfor other users. In some cases, advanced graphic processing and 3Drendering may be used for the user to try on the product beingresearched, such that the user may see themselves virtually dressed inthe product in accordance with a digital simulation that places theproduct onto the user shopping avatar. The user may use the shoppingavatar to provider further feedback to modify the user's shoppingprofile.

At step 340, a personalized product may be ordered by a user from aphysical store, for example, for a product that is in principleavailable but not currently in the store, or to allow manufacturing of aspecifically required product based upon the user's shopping avatar,such that the product is a customized product for a user.

At step 345, the user can select a personalized product and/or modify ordesign a product, optionally based on a product that the user has seen,liked, and/or chosen in the store, to purchase a custom product thatwill be created and/or manufactured for her/him. These modifications mayinclude visual changes, such as name engraving, colors, materials,prints etc., as well as physical properties, such as controlling theheight of the heels in shoes, the thickness of a frame in eyewear etc.At steps 340 and 345, these features may allow the in-store customers toenjoy features that are typically limited to e-commerce and onlineshopping.

Reference is now made to FIG. 4 , which is a flow diagram forfacilitating a personalized online shopping experience, according tosome embodiments. As can be seen, an online store may acquire productinformation from a product database 400, for a selection of products tobe offered to online users. At step 405 history data for an online usermay be retrieved, for example, based upon previous user purchases andresearch. At step 410 user preference data may be acquired, such assize, color, material, type preferences etc. At step 415, scanned orgraphic data may be acquired for a user, for example, from standardphotographs, 2D and/or 3D image scanning, or from capture and processingusing a POS kiosk or apparatus etc. In some embodiments, a dedicated orgeneric application on a smart phone, tablet, or other computing devicemay be used to allow effective photographing or scanning of a user. Inother embodiments a webcam, 3D camera, video recorder etc. may be usedto acquire scanned or graphic data. At step 420, this graphic data isused by the personalized shopping system, together with the variousinput data from steps 405, 410 and 415, to generate a multidimensionaluser shopping avatar or profile that includes user physical propertiesas well as user behavior and user preference data.

At step 425, a matchmaking of the user shopping profile to productsbeing researched or required is executed. At this step, the product datafrom product database 400 is matched to products being researched by auser, in accordance to the specific user shopping profile, therebyallowing advanced recommending of product matches, for example, to aidfiltering out of non-appropriate products for the specific user, and theadvanced matching up of appropriate products, in accordance with thespecific user's personal shopping profile and preferences.

At step 430 product fitting data from feedback of remote people, such asfamily members, friends or shopping assistants connected via a smartphone or computer for example, may be used to help modify thematchmaking of user data to product data, for example, to include datarelating to which colors look good on a person or which size looks bestetc. may be used by the user to update their shopping profile. Infurther examples, code may be used to provide product colorrecommendations, size or fit recommendations etc. This feedback may becollected actively from the user or statically, for example based on thepurchase information, shipping data, etc. At step 435 feedback may beacquired from social networks or to which a user is connected, to helpmodify the user shopping profile. In addition, a human and/or machinebased digital representative, style expert, and/or additional guidinginformation may be inputted to improve the guidance and support providedto the shopper in the online purchase process. In some cases, advancedgraphic processing and 3D rendering may be used to allow the user tovirtually try on the product being researched, such that the user maysee themselves dressed in the product in accordance with a digitalsimulation that places the product onto the user shopping avatar. Thismay be done using real-time simulation, allowing for a live stream ofanimated video or high resolution images of the simulation etc. The“digital try-on,” in some embodiments, may include a physics simulationto include the exact positioning of the element on the avatar inmovement on in a static position. As described herein, the user may usethe shopping avatar to provider further feedback to modify the user'sshopping profile.

At step 440, a product may be ordered by a user from an online store.Optionally, at step 445, a personalized product may be generated by auser from an online store, to allow manufacturing of a specificallyrequired product based upon the user's shopping avatar, such that theproduct is a one-off customized product for a user. The shopping system,in case of a custom manufacturing output, may if needed, connectdirectly to the company production hardware and ERP system to facilitatesuch personalized product manufacturing. In one example, thepersonalized product may be represented in 3D printer files such as STLmodels or digital cutting devices, such as DXF or DWG files. In otherembodiments, this could be a custom routing card or productioninstruction and BOM files. Additional input may include be visualrenders that will help a product manufacturer or printer to visuallydesign the custom product.

In some embodiments, the data from product database 400 may be used,together with the body or avatar profile derived in step 420, to developa customized product at step 445, optionally without product matchmakingat step 425.

Reference is now made to FIG. 5 , which is a flow diagram indicating anexample of personalized hybrid shopping experience, according to someembodiments. As can be seen in the figure, at the backend or computingsystem supporting a physical and/or online store, product informationfrom a product database 500 may be used for products to be discovered,purchased, or manufactured by an online or in store user. At step 505history data for a user may be retrieved, for example, based uponprevious user purchases in a store or chain of stores, whether fromonline and/or in store experiences. At step 510 user preference data maybe acquired, such as size, color, material, type preferences etc. Atstep 515, at the frontend or user side, whether executed by the user orby a shopping assistant, scanned, or graphic data may be acquired for auser, for example, from standard photographs, 2D and/or 3D scanning, orfrom capture and processing using a POS kiosk etc. In some embodiments,a dedicated or generic application on a smart phone, tablet, or othercomputing device may be used to allow effective photographing orscanning of a user. In further embodiments, a dedicated or genericcamera or scanning device may be used by a shopping assistant, which mayinclude portable or non-portable devices, kiosk type or stand-alonedevices. At step 520, this graphic data is used by the personalizedshopping system, together with the various input data from steps 505,510 and 515, to generate a multidimensional user shopping avatar orprofile that includes user physical properties as well as user behaviorand user preference data. One advantage of this system is the seamlesstransfer in which the users can transition between online and offlineshopping, while enjoying the benefits of personalization, using aconstantly updated personal profile in the online and/or in-storescenarios.

In some embodiments, at step 525, a matchmaking of the user shoppingprofile to products being researched or required is executed, for anonline shopping optionally located in a physical store. At this step,the product data from product database 500 is matched to products beingrequested by a user, in accordance to the specific user shoppingprofile, thereby allowing advanced filtering out of non-appropriateproducts for the specific user, and the advanced matching up ofappropriate products, in accordance with the specific user's personalshopping profile and preferences. This advanced filtering allows a shopsalesperson, for example, or the user themselves, to be presented withsubstantially appropriate products, optionally products that arecurrently available, rather than have the user select items that arenon-appropriate, thereby wasting time and resources of shoppingassistants and/or the shopper themselves.

At step 530 product fitting data from feedback of physically presentpersonnel or remote people may be used to help modify the matchmaking ofuser data to product data, for example, the feedback from a salespersonin a store may be used to update the user profile, or the feedback fromremote people connected via a smart phone or computer for example. Insome cases, for example, salesperson or friend feedback, such as whichcolors look good on a person or which size looks best etc. may be usedby the user to update their shopping profile. At step 535 feedback maybe acquired from social networks or to which a user is connected, tohelp modify the user shopping profile. In some cases, advanced graphicprocessing and 3D rendering may be used for the user to virtually try onthe product being researched, such that the user may see themselvesdressed in the product in accordance with a digital simulation thatplaces the product onto the user shopping avatar. As described herein,the user may use the shopping avatar to provider further feedback tomodify the user's shopping profile.

At step 540, a product may be ordered by an online user in a physicalstore. At step 550, a personalized product may be ordered by an onlineuser in a physical store, for example, for a product that is inprinciple available but not currently in the store, or to allowmanufacturing of a specifically required product based upon the user'sshopping avatar, such that the product is a customized product for auser.

In some embodiments, at step 545, a matchmaking of the user shoppingprofile to products being researched or required is executed, for userlocated in a physical store. At this step, the product data from productdatabase 500 is matched to products being requested by a user, inaccordance to the specific user shopping profile, thereby allowingadvanced filtering out of inappropriate products for the specific user,and the advanced matching up of appropriate products, in accordance withthe specific user's personal shopping profile and preferences. Thisadvanced filtering allows a shop salesperson, for example, or the userthemselves, to be presented with substantially appropriate products,optionally products that are currently available, rather than have theuser select items that are inappropriate, thereby wasting time andresources of shopping assistants and/or the shopper themselves.

Reference is now made to FIG. 6 , which is a flow diagram indicating anexample of personalized shoes shopping, online or offline, according tosome embodiments. As can be seen in the figure, insole information froman insoles product database may be acquired at 600. In addition, shoelast information from shoe lasts product database may be acquired at605. In some cases, inner sole data, shoe last data and/or shoe modeldata may include data about each product's shape, volume, materials ofshoes, closure type, shoe type, width, length, height, thickness,elasticity of materials, comfort fit etc. In some examples, meshanalysis and digitization may be provided, for example, to run a meshanalysis of each 3D last, combined with 2D DXF data, to be added to shoelast database 605. In addition, shoe model data for shoes to bediscovered, purchased, or manufactured may be acquired from shoe modelsdatabase 610. In some cases, for example, 3D Sit files may be importedfor shoe lasts, and 2D DXF files may be imported for last bottoms.

At step 615, scanned or geometrical data may be acquired for a user, forexample, from standard photographs, 2D and/or 3D image scanning, or fromcapture and processing using an automated shopping assistant apparatusetc. This graphic data may be processed at 620, by the personalizedshopping system, over the cloud or in the unit itself, in order togenerate a user's physical profile based on the user's physicalproperties. The profile may include all or some of the followingattributes: a 3D mesh including the exact geometry of the profile, a 3Dmesh including the exact geometry of one or more parts of the user'sbody, 2D images, properties calculated from one or more of the inputmethods, including specific volumes, cross section measurements,specific distances and lengths, as well as non-numeric attributes suchas preferences etc. For example, a user's foot or both feet together maybe pictured or scanned while standing on the floor or on another othersurface, on or near a reference object, etc. Further, the user's foot orfeet may be scanned by the camera scanning around the different anglesof the feet, or by the person moving around the camera, therebygenerating a 3D model, a movie, or a set of images as reference. Thescanned data may typically be processed, optionally includinginterpolation and/or cleaning, to allow for object identification andmesh generation, or other suitable processing means. In some cases,meshing may further allow removal of excess geometries and/or fixing ofmesh errors, for example, including separation, identification, andpreparation of each of the feet, removal of the floor, pants or otherexcess materials from the scans etc. Scanned data processing may, insome cases, allow for feet alignment, which also helps separation orindividualization of the two feet, to provide accurate measurement ofboth feet, including dimensional analysis to determine general and areaspecific lengths, width and height, and Cross sectional analysis todetermine area, perimeter, and other dimensions at specific crosssections. Scanned data processing may allow for smoothing of the edgesof the scanned feet, building of missing volumes, constructing of thesoles of the feet etc. In some cases, full foot volume and/or areaspecific volume may be extracted from the model as additionalinformation. At step 625, the processed user scanned data may beparameterized, for example, to extract precise length, width, height,arch, ball, cross section, circumferences, volume dimensions, etc. Theseparameters may be calculated off the clean 3D mesh using specificalgorithms. For example, the calculation of the foot arch height off amodel that was scanned in the standing position is complex and may bebased on comparison of XYZ parameters of various anatomical partsthroughout different cross sections in the center of the foot. The widthof the foot may be calculated based on the volume of the toe boxcalculated both at a 3D mesh and/or 2D cross section level asappropriate to the requirements of specific applications of embodimentsof the invention. The length of the foot may be calculated from acombination of the total length and the “ball length” which representsthe distance between the heel of the foot and the first metatarsal. Inaddition, user specific conditions, such as sores, infections, damageetc. can also be identified and integrated into the user's shoe shoppingprofile. At this step, the pronation or supination condition of the footmay also be analyzed. Additionally, the arch of the foot may beidentified and measured for fitting of support insoles or otherprosthetics.

At step 630 history data for a user may be retrieved, for example, basedupon previous user purchases in a store or chain of stores, whether fromonline and/or in store experiences. At step 635 user preference data maybe acquired, such as size, color, material, type preferences etc. Atstep 640 a multi-dimensional user shoe shopping profile, hereinafterreferred to as a user shopping avatar, may be created, by processing thevarious input data from steps 615, 620, 625, 630 and 635, therebygenerating a user shoe shopping avatar or profile that includes userphysical properties as well as user behavior and user preference data.In some embodiments, the user shoe shopping profile includes both feetof the user, which are typically different and for which parameters aredetermined individually, thereby benefitting from individual profilesfor left and right feet.

At step 645, a matchmaking of the user shoe shopping profile to shoeproducts being examined, researched, or required is executed. At thisstep, the product data including dimensions, from product databases 600,605 and 610 is matched to products being researched by a user, inaccordance to the specific user shopping profile, thereby allowingadvanced filtering out of inappropriate products for the specific user,and the advanced matching up of appropriate products, in accordance withthe specific user's personal shopping profile and preferences. The stepof matching may be complemented by a provision of recommendations forthe user, based on the profile to the user's matchmaking process. Thisstep may use the models of the foot and shoe digital profiles directly,and/or the parametrized numeric model.

At step 650 product fitting data from feedback of physically presentpersonnel or remote people may be used to help modify the matchmaking ofuser data to product data, for example, the feedback from a salespersonin a store may be used to update the user profile, or the feedback fromremote people connected via a smart phone or computer for example. Insome cases, for example, salesperson or friend feedback, such as whichcolors look good on a person or which size looks best etc. may be usedby the user to update their shopping profile. In some cases, advancedgraphic processing and 3D rendering may be used for the user to try onthe product being researched, such that the user may see themselvesvirtually dressed in the product in accordance with a digital simulationthat places the product onto the user shopping avatar. In a variety ofembodiments, a model is dynamically generated based on the productfitting data and/or user profile and augmented by modifying thegenerated model to incorporate the model of the product being tried on.This model can then be displayed using any of a variety of devicesdescribed herein, thereby allowing the customer to preview the products.As described herein, the user may use the shopping avatar to providerfurther feedback to modify the user's shopping profile. At step 655feedback may be acquired from social networks to which a user isconnected, to help modify the user shopping profile.

At step 660, a personalized pair of shoes may be ordered by a user,whether inside a physical store or in an online store. Further, apersonalized product may be ordered from a manufacturer who may producea product based upon the user's request such that the product is aonce-off customized product for a user. Customized footwear based onthis invention may be customized and/or personalized, for example, in ofone or more of the following ways: shape (e.g., size, length, geometry,and/or volume), design (e.g., colors, patterns, print, and/or materials)or any other specification or combination of the above.

Reference is now made to FIG. 7 , which is a flow diagram indicating anexample of personalized eyewear shopping and manufacturing, online oroffline, according to some embodiments. This embodiment refers to bothsunglasses and any type of optical glasses. As can be seen in thefigure, glasses models information from glasses product database may beacquired at 700 from a glasses models or products database of variousfile types or data structures. According to some embodiments, glassesframe acquisition may be allowed by preparing parametric models, forexample, by generating model parameters for multiple to input types,handling resolution adjustment, allowing automatic rigging and/orskinning, integrating range of motion animation and correctiveshape-keys, etc.

At step 705 history data for a user, for example including facialanatomical landmarks and measured distances such as inter populardistance, location of each eye, cheek, temple, and various points on theear and the nose etc., may be used. The general parameters of each faceare also loaded, optionally including the volume, proportions andstandard shape, may be retrieved, for example, based upon previous userexaminations and/or purchases in a store or chain of stores, whetherfrom online and/or in store experiences. At step 710 user preferencedata may be acquired, such as size, color, material, type preferences,usage needs etc. This data may be acquired directly or indirectly, forexample, using purchase information, questionnaires, forms, and/or anyother data acquisition method.

At step 715, scanned or graphic data may be acquired for a user, forexample, from standard photographs, 2D and/or 3D image scanning, or fromcapture and processing using an automated shopping assistant. Thisincludes, for example, any type of 3D scanning technology, as describedherein or alternative 2D method using or not using reference objects forsizing. Typically, user head and face scan data may be acquired at thisstage. In some embodiments, head and face model preparation and analysismay include model preparation such as smoothing and cleaning, rebuildingof the mesh with enhanced topology and/or optimized detail/weight ratiocompression for optimal display in real-time, and/or orientation andalignment. Further, facial feature recognition may be used, for example,to generate a facial model rendered from multiple angles (e.g. 3 to 15angles, to help determine normal, depth, color, or other parameters).Moreover, computer vision and/or machine learning algorithms may beapplied, for example, to identify the eyes, nose, nose bridge, temples,ears, etc. The processing of the scanned data may further includeprojection of 2D landmarks to the 3D model, and validation of anatomicallandmarks. In the case of absent landmarks, an assessment based onstatistic or empiric results may apply for replacement of theselandmarks.

At step 720 the processed user scanned data may be parameterized, forexample, to extract the precise face length, width, height, proportions,nose width and volume, ear size, ear height, ear position, skin color,and/or other relevant facial characteristics and dimensions etc. Thisdata may be processed by the personalized shopping system at 725,together with the user history data from 705 and user preferences dataat 715, to generate a user glasses shopping profile based on the user'sface profile and other physical properties, as well as user behavior anduser preference data. In some embodiments the user glasses shoppingprofile includes both eyes of the user, which are typically different,thereby benefitting from individual profiles for left and right eyes. Insome embodiments, the optical prescription will be collected using apicture, an e-form, or an embedded testing method inside the applicationor, in some cases, from external prescription files. According to someembodiments, the system may recommend specific models based on the faceshape, previous purchases and history, and optionally based on acomparison (optionally anonymous) to similar avatars,

At step 730, a matchmaking of the user glasses shopping profile to theglasses products being researched or required is executed. At this step,the product data from product database 700 is matched to products beingresearched by a user, in accordance to the specific user shoppingprofile, thereby allowing advanced filtering out of non-appropriateproducts for the specific user, and the advanced matching up ofappropriate products, in accordance with the specific user's personalshopping profile and preferences.

At step 745, each frame is adjusted to fit on a user's face using frameCustomization, that may include, for example: Taking key measurements ona subject or user's face; applying iterative comparison algorithms toadjust the frame to the face; digitally positioning the frame on thesubject's face, orienting the frame appropriately to the face, scalingnose bridge size, width and position, adjusting arm folding, arm length,and pantoscopic tilt or angle, in accordance with the subject's face, asper the prepared user glasses shopping profile or avatar, etc.

At step 735 product fitting data from feedback of physically presentpersonnel or remote people may be used to help modify the matchmaking ofuser data to product data, for example, the feedback from a salespersonor optometrist in a store may be used to update the user profile, or thefeedback from remote people connected via a smart phone or computer forexample. In some cases, for example, salesperson or friend feedback,such as which colors look good on a person or which size, style, models,type looks best etc., may be used by the user to update their shoppingprofile.

In some embodiments, at step 745, advanced graphic processing may beused for the user to virtually try on the product being researched, suchthat the user may see themselves dressed in the glasses in accordancewith a digital simulation that places the glasses onto the user shoppingavatar's face. The virtual try-on may, in some embodiments, includefeatures such as physical simulation that positions the glasses at thecorrect or optimal position and can slide these along the nose. Inaddition, the try-on may include an overlay of a picture or 3D model ontop of the face model and/or a series of pictures or any combination ofthe above. Animated effects may be included to emphasize the differentattributes of the glasses including customization animation in the caseof custom frames, or other animation such as fly in/fly out animationfor switching between pairs. As described herein, the user may use theshopping avatar to provider further feedback to modify the user'sshopping profile. In some embodiments, the user may view the customizedframe on a digital version of his/her face, to provide profound visualfeedback. For example, the user's face may be shown in a 3D viewer andthe appearance may be enhanced, so as to provide one or more of 3D viewmanipulation (e.g. zoom, rotation), and animated effects to complimentuser experience, such as a breathing face, smile, blinking or otheranimated or static visual effects. Further, the user may thus beprovided with customization options including choosing any frame fromthe collection, customizing the frame and lens colors, customizing anautomatic recommended fit, personalization of a file (e.g. text,prescription etc.), and allowing side-by-side comparison betweendifferent frames. In a variety of embodiments, a model is dynamicallygenerated based on the product fitting data and/or user profile andaugmented by modifying the generated model to incorporate the model ofthe product being tried on. This model can then be displayed using anyof a variety of devices described herein, thereby allowing the customerto preview the products. At step 740, feedback may be acquired fromsocial networks or to which a user is connected, to help modify the usershopping profile Of course, other steps of combinations of steps may beused to process the input data.

Step 750 refers to an embodiment in which the system allows productionof custom eyewear based on automated or semi-automated parametric designof the frame to fit the user. At step 750 relevant glasses productionprinting and cutting files may be prepared by the system, if necessary.In some embodiments, 3D printing files of standard forms for examplesSTL or OBJ and 2D lens cutting files such as DXF etc. may be prepared.In some embodiments, the system creates two or more pairs of models foreach of the frame designs. This allows, for example, for a lightweightmodel to be used for visualization purposes on the frontend of theapplication while maintaining a high-resolution model for the printingfile preparation that may include, for example, high-resolution featuresand details, such as hinges, grooves, angles, earpieces etc. The eyewearcustomization of print models described herein may be automatic and/ormanual. Further, the file preparation for 3D printing may includeautomatically fixing of printability issues, generation of normal,duplicates, holes and non-manifold geometry etc. In some embodiments,the system may create custom tags on the glasses or eyewear, forexample, including text, QR code, and/or barcode that would allowtraceability throughout the production and distribution process.

At step 755, a personalized pair of glasses may be ordered by a user,whether inside a physical store or an online store. Further, apersonalized product may be requested from the store, or ordered from amanufacturer who may produce a product based upon the user's requestsuch that the product is a once-off customized product for a user.

According to certain embodiments, a system and process are described forautomated personalized product ordering using a digital mirror orpersonalized viewing protocol. This embodiment may integrate virtualreality and/or augmented reality to manipulate, view and/or try ondesignated equipment such as existing or designed glasses, on a screen,table, smartphone, communications device etc., to allow visualrepresentation of the custom or non-custom frames on the face of theclient.

According to certain embodiments, a file format adapted to allowpersonalized product ordering is provided. This file format incorporatesall of the relevant information, including physical properties andpersonal preference, to represent a user and help the user performpersonalized custom or non-custom shopping for clothing, eyewear,footwear, or other body related products. This avatar standard formatmay be used to plugin into substantially any shopping platform, onlineor physical, to allow customization of the store to fit the physical andaesthetics needs and preferences of a customer.

Reference is now made to FIGS. 8A-8G, showing different views of a POSapparatus, launchpad, or kiosk, according to some embodiments, in someembodiments, the shopping assistant apparatus generates a user avatarbased on one or more of 3D scanning, image acquisition using one or morecameras, measuring a user profile with pressure plates, etc. In someembodiments, a standing pad may be used to function as a positioning pador reference for a user to stand on to perform a body scan. In somecases, the standing platform may include lighting at the bottom of thestanding pad, to support acquisition accurate measurement of any colorsfrom cameras or scanners on the apparatus, by minimizing ormarginalizing shadows, and causing a black/white perimeter effect. Insome embodiments, there may be a proximity sensor for each foot tomeasure if the feet are in place or close, and tell the user to move ifnecessary. Further, the apparatus may include a distance or proximitysensor/robot that recognizes approaching user to attract the user to theapparatus, in which case the apparatus may be automatically started whena user enters a selected geographical zone. In further embodiments, asensor may be used for measurement of the height of a user's instep—toestablish instep volume, for example. In still further embodiments,specialist sensors may be used, for example, sensors to measure diabetessores etc. Such sensors, such as cameras, 3D sensors, all aroundcameras, and or multiple cameras may be used.

FIG. 8A is an exploded view of an example of the components of the POSapparatus or kiosk device in accordance with an embodiment of theinvention. As can be seen, the kiosk device 800 may include a standingbase 805, a light source for optionally lighting the standing base,proximity sensor(s) 816, for identifying the positioning of feet to bescanned by kiosk device 800, a standing pad 815, with space for standingon with both feet, and a pad layer 820, on which the feet are mountedon. In some embodiments pad layer 820 may be integrate a pressuresensing mechanism, such as flatbed scanner; plate of pins; pressureplate; touch screen type surface with a capacitor and/or pressure sensorelement etc., to determine foot arch dimensions. In some embodiments,arch dimension measurement element(s) may be used to determine a needfor and/or dimensions of an inner sole(s) for a user.

In some embodiments, arch dimension measurement element(s) may be usedto determine a need for and/or dimensions of a user's instep profile.

In some embodiments, arch dimension measurement element(s) may be usedto determine a need for and/or dimensions of a user's ball (of the foot)profile.

In other embodiments one or more lasers or other lighting mechanisms maybe used to determine foot arch, ball, or in step dimensions. In oneexample, a laser from above and/or below the foot may be used to showthe height or arch and/or size of a bridge of the foot, for example, byidentifying the size of the “hidden” area not seen by laser, and usingthe “hidden” space to determine parameters such as height, at differentpoints on the foot. In a further example, diffraction grating, prism, orother filters can use multiple lines to be able to identify high pointsand/or contours of the foot.

In still further embodiments, one or more lights, optionally ofdifferent colors, separately and/or in combination, may be used,together with image processing to neutralize a color of a sock and/orfoot, and help identify non-foot space. In other embodiments, one ormore may be identified with the arch of a foot, for example, using abackground elimination technique.

Further, kiosk device 800 may include a main body 822, including acomputer holding stand 825, and a camera holding element 826, forholding one or more camera elements 835, a panel element 830, a furtherpanel or cover element 845, a computing screen, preferably a touchscreen PC or tablet 840, and optionally having a place for setting up aproximity sensor 850, for example, for identifying a user proximity tothe computing device.

FIG. 8B is a front view of an example of the POS apparatus or kioskdevice. FIG. 8C is an isometric view of an example of the POS apparatusor kiosk device. FIG. 8D is an isometric front view of an example of thePOS apparatus or kiosk device. FIG. 8E is an isometric back view of anexample of the POS apparatus or kiosk device. FIG. 8F is a side view ofan example of the POS apparatus or kiosk device. FIG. 8G is a top viewof an example of the POS apparatus or kiosk device. FIG. 8H is a view ofan example of one or more sensors in POS apparatus or kiosk device. Ascan be seen, the kiosk device, multiple sensors may be configured, forexample, one or more proximity sensors, a LED flatbed may be configuredfor providing a light source from under the standing area.

Reference is now made to FIG. 9 , which shows a schematic view of theshopping assistant system 900, including automated shopping assistantapparatus 906, which integrates a computing component adapted to run ashopping assistant application or software program 915. Automatedshopping assistant apparatus 906 is adapted to connect to acommunications network, such as communications cloud 920, to access theuser shopping profile 925, if on the cloud, and/or transmitting the usershopping profile to the cloud. Further, a remote user mobile device,such as a smart phone, tablet or other camera supporting mobilecommunications device 905, 910, according to some embodiments, which areadapted to run a shopping assistant application or software program 916.Devices 905 and 910 typically include one or more cameras 910, forexample to allow capturing information about a person's foot or bothfeet optionally simultaneously using a standard picture/scan, video,series of pictures or advanced sensing components such as structuredlight, time-of-flight or others in IR/near-IR or visual lightconditions. Devices 905/910 typically include a gyroscope and/oraccelerometer to provide camera orientation data to the device camera,for example, to only allow a picture to be taken when the camera issubstantially flat. In some embodiments, internal sensing componentsand/or additional sensors may be attached to the communications devices905, 910 to supply supplementary data to the system. For example, suchsensors may assist in improving accuracy of measurements, assisting theuser during the capturing of the data with real-time feedback, and/orproviding input to the calculation engine. Remote devices 905 and 910may communicate with communications cloud 920, and in particular, may beconnected to the device user's digital shopping avatar or profile 925.In some embodiments, a user may generate the shopping profile using themobile device 905,910, for one or more users, in addition to or in placeof the automated shopping assistant apparatus 906. In a variety ofembodiments, the shopping assistant application or software program 916includes an application programming interface (API) and/or a softwaredevelopment kit (SDK) that can be utilized by a third-party softwareapplication (executing on the mobile communications device and/or aremote system) to incorporate some or all of the features describedherein.

Reference is now made to FIG. 10 , which shows a schematic view of theshopping assistant system 1000, and the workflow between the components.As can be seen, the launch pad or shopping assistant apparatus 1005 canscan a user, for generation of a shopping profile for the user. Thegenerated profile is sent to the user's mobile device 1010, and cansubsequently be used for scanning products, such as shoes 1015,optionally via a product tag, such as QR code 1020, representing theselected product. Further, in some embodiments, the user may build ashopping profile using a mobile Application 1025. In some embodiments,the user shopping profile can be used to augment in store shopping, at1030. In some embodiments, the user shopping profile can be used toaugment online shopping, at 1040.

Reference is now made to FIG. 11A, which is a flow diagram indicating anexample of personalized footwear shopping in a shopping store using anin store or POS automated shopping assistant apparatus, in combinationwith a mobile computing device application. As can be seen, at step1100, a user may be identified via a proximity sensor of a shoppingassistant apparatus. At step 1105, the user may be requested to stand onthe marked pad, and optionally provides interactive guidance to makesure the user stands in the correct position to allow accurate scanning.At step 1110, the apparatus scans the body or body parts/elements, andat step 1115, generates a shopping profile based on the scan. At step1120, the apparatus may present the shopping avatar to the user in agraphic format. At step 1125, the apparatus may send the shopping avatarto the user's mobile device. At step 1130, the user may open a shoppingapplication that may use the application to assist with shopping and/orresearch. At step 1135, the user may use the avatar on their mobiledevice to shop or do research, for example, by scanning selectedproducts using coded tags, for example, QR codes or barcodes. Ingeneral, the scanned products may be processed in a way that relates tothe user avatar, for example, to determine if the product will fit theavatar, suits the user's profile or preferences etc. In some cases, theapplication may provide a graphic simulation of the selected product onthe avatar. At step 1140, the application may connect to acommunications cloud or other database, to match the selected product(s)with product data, for example, to help determine purchasing options,inventory status, product qualities, product features, reviews, sizesetc. In some cases, at step 1145, the application may present the userwith recommendations, purchase data etc. In still further steps, theapplication may augment the in-store shopping experience, for example,by providing shopping advice, options, shortcuts, access to additionaldatabases etc.

Reference is now made to FIG. 11B, which is a flow diagram indicating anexample of personalized footwear shopping in a shopping store using anin store or POS automated shopping assistant apparatus, in combinationwith a mobile computing device application. As can be seen, at step1100, a new or known user can be entered on the shopping assistantapparatus—for example, via a biometric identifier, entry screen etc. Atstep 1105, the user may be requested to stand on the marked pad, andoptionally provides interactive guidance to make sure the user stands inthe correct position to allow accurate scanning. At step 1110, theapparatus scans the body or body parts/elements, and at step 1115,processes the scan data and generates a shopping profile based on thescan. At step 1120, the apparatus may present the shopping profile as asimulation, shopping avatar or other virtual assistant, to the user in agraphic or other format. At step 1125, the apparatus may send theshopping avatar to the user's mobile device, in a format orconfiguration usable by the device's software, code, or application(s).At step 1130, the user may open a shopping application or other programthat may operate the shopping avatar with a shopping assistantapplication. At step 1135, the user may use the avatar on their mobiledevice to shop or do research, for example, by scanning selectedproducts using coded tags, for example, QR codes or barcodes. Ingeneral, the scanned products may be processed in a way that factors inthe generated shopping avatar, for example, to determine if the productwill fit the avatar, suits the user's profile or preferences etc. Insome cases, the application may provide a graphic simulation of theselected product on the avatar. At step 1140, the application mayconnect to a communications cloud or other database, to match theselected product(s) with advanced product data, for example, to helpdetermine purchasing options, inventory status, product qualities,product features, reviews, sizes etc. In other cases, at step 1140, theapplication may connect to a communications cloud or other database, tomatch the selected product(s) with advanced user data, for example, tohelp determine user preferences, user history, and user profile updatesetc. In some cases, at step 1145, the application may present the userwith recommendations, purchase data, purchase choices, reviews, newsetc., to help augment the online store shopping experience. In somecases, at step 1150, the application may present the user withrecommendations, purchase data, purchase choices, reviews, news etc., tohelp augment the in-store shopping experience, for example, by providingshopping advice, options, shortcuts, access to additional databases etc.

In some embodiments, the user shopping experience may be executed foradditional users connected with a user of the shopping assistant. Insuch cases, the user application may contain shopping profiles ofmultiple users, thereby allowing the user of the mobile device toexecute shopping for multiple users in according to the users' shoppingprofiles.

In accordance with some embodiments, mobile and/or user avatars may beshared with other users. For example, a user may have access to orcontrol multiple user profiles, with the users' authorization, forexample, in a wallet or holder of avatars or profiles. In such a case,the controlling user may shop on behalf of other users. For example, aparent may keep the profiles of all their family members, allowing theparent to easily shop online and/or offline for all the associatedfamily members.

In accordance with some embodiments, additional personalization can beprovided for each user mobile shopping avatar or user shopping avatar,such as an icon or picture. Such personalization may be particularlyuseful for a controlling user to manage multiple user or mobile shoppingavatars. This information associated with any identifier may be saved onthe cloud avatar database and associated with a user in any platformthat s/he uses. For example, in the case where a family member scans andsaves one or more of his or her family members' profiles, these may beshared with another family member(s) who can now load them into anin-store system or an ecommerce website being used, and subsequently usethis personalized information. In the case of a website, the output maybe personalized in accordance to this personalized data and may eveninclude the other user's picture or avatar or 3D model right next to theinformation provided, to reassure the user's confidence that therecommendations are personal and based on his or her profile, or otherprofiles being legitimately used by the user.

In accordance with some embodiments, an online store may include a usershopping virtual assistant, using a profile plug in or other digitalobject, that may appear on substantially any webpage (whether optimizedfor mobile phone, desktop, notebook, tablet, wearable etc.), whenrelevant, to offer recommendations, guidelines or other assistance tothe user. For example, the virtual shopping assistant may showinformation about different fits for the user profile being used, orotherwise assist the user. For example, a user with a foot size of 41European, while shopping or browsing in the Nike online store, may beinformed that the equivalent size for their feet profile in Nike shoesis 42 European or US size 10.5. Additionally, if the user profileincludes preference data, such as preferred colors and fits etc. theshopping virtual assistant may also provide suggestions or guidelinesbased on the user preferences. For example, in the Nike shoes store, theshopping assistant may suggest to the user to look for options that are10.5 American size, in athletics shoes, in either blue or green, etc.

In some embodiments, the virtual assistant may take the user directly toa page or pages that match the user shopping profile data andpreferences. In one embodiment, the profile may direct the website intothe sections that are interesting or relevant to a specific user whileavoiding irrelevant pages. In a variety of embodiments, the system mayuse the personalized information, alone or in aggregate with additionalusers, to rearrange the website and create a personalized version of thewebsite that may represent what s/he may be most interested in and whatwould best fit for him or her.

In accordance with some embodiments, the virtual shopping assistant mayallow rendering of 3D views of a product being viewed, and optionally ofa personalized product. For example, a custom shoe being viewed inaccordance with a user's shopping profile may be rendered in 3D from allsides and/or angles to assist the user is viewing the product frommultiple dimensions.

In accordance with some embodiments, a virtual fitting module may beprovided, to allow dressing of the shopping avatar with the product(s)being viewed.

In accordance with some embodiments, a user shopping avatar may be aonce off avatar for a store. In other embodiments, the user shoppingavatar may be applicable to a chain of stores. In other embodiments theuser shopping avatar may be applicable to a variety of brands or stores,for example, all owned by a parent entity. In other embodiments, theuser shopping avatar may be applicable to any or all stores, viaconnecting to the universal user profile in the cloud.

Reference is now made to FIGS. 12A-12B, which are examples ofscreenshots showing interactive screens of the shopping assistantscreen, for guiding a user to place their feet on the marked pad,according to some embodiments;

Reference is now made to FIGS. 13A-13B, which are examples ofscreenshots showing an interactive guide of the shopping assistantscreen or mobile screen, for helping the user to define their profile,and their contact information, according to some embodiments;

Reference is now made to FIGS. 14A-14B, which are examples ofscreenshots of the shopping assistant screen or mobile screen, showing asimulated rendition of a pair of scanned feet and lower legs, accordingto some embodiments;

Reference is now made to FIGS. 15A-15B, which are examples ofscreenshots of the shopping assistant screen or mobile screen, forassisting a user in entering behavior related information that may beused to provide better user related output.

Reference is now made to FIGS. 16A-16D, which show a set of perspectiveviews of an example of a shopping assistant standing surface, accordingto some embodiments. As can be seen in the figures, standing surface1600 is generally a flexible surface, such as a mat or carpet,optionally constructed from PVC, rubber, polyurethane, paper, cardboard,or any other suitable material. Standing surface 1600 typically includesa 3D part or element 1605 that replaces a wall, and allows correctpositioning of feet for scanning. This 3D element functions as a footbarrier against which the back of the foot is placed. Standing surface1600 typically includes markings 1610, dots or indicating graphics, toenhance accuracy of scanned images. In some embodiments, markings 1610may function as markers that may have differing sizes, dimensions,functions etc. The markers can be all the same or some may be differentfrom others.

FIG. 17 shows an additional version of a shopping assistant standingsurface, according to some embodiments. As can be seen, there is a 3Dfoot placement element 1705 for each foot.

FIG. 18 shows a further version of a shopping assistant standingsurface, according to some embodiments. As can be seen, there is adifferently shaped 3D foot placement element 1805.

FIG. 19 shows a first user case in which a virtual graphic example isprovided showing usage of the shopping assistant apparatus, according tosome embodiments. As can be seen, the assistant 1900 may photograph orscan system user 1905, using a standard camera 1910 (e.g., phone ortablet) and/or a depth camera.

FIG. 20 shows a second user case in which a virtual graphic example isprovided showing usage of the shopping assistant standing surface,according to some embodiments. As can be seen, the system user 2000 mapperform a self-picture or scan, using a standard camera 2005 (e.g.,phone or tablet) and/or a depth camera.

FIG. 21 is a picture showing an example of a user positioned on ashopping assistant standing surface, according to some embodiments. Ascan be seen in the picture, standing surface 2100 typically includes a3D part or element 2105 that replaces a wall, and allows correctpositioning of feet for scanning. This 3D element functions as a footbarrier against which the back of the foot is placed. Standing surface2100 typically includes markings or indicating graphics 1610.

In some embodiments, the shopping assistant standing surface may includeactive components such as light, detector, sound etc. In such cases, theshopping assistant standing surface may include a power source,optionally battery powered, and one or more suitable sensors.

In some embodiments, the shopping assistant standing surface may includea pressure plate (optionally having Bluetooth or other wirelesscommunication capabilities) to assist in receiving additional data onthe shape of the user's arches.

In some embodiments, the shopping assistant standing surface may befoldable, for example for storage, transportation, or display reasons.

In a further configuration, the shopping assistant standing surface maybe integrated onto a fitting chair as can be seen with reference to FIG.22 .

In some embodiments, the shopping assistant standing surface may includetwo standing sides with two different colors (e.g., for imagerecognition).

In some embodiments, the shopping assistant standing surface may beplaced on, fitted onto, or integrated with a fitting chair or stool. Insuch cases, the standing surface may be placed to receive a user's feetwhen in sitting pose.

In some embodiments, the shopping assistant standing surface may includean augmented reality (AR) functionality, thereby allowing the userstanding on the standing surface to browse through shoes on his or herfeet and see them on the generated model. For example, this may allowthe customer looks at his/her bare feet or feet with socks, and seethrough AR glasses or a phone/tablet different shoes that s/he canbrowse from in augmented reality tracking based on her/his feet.

In some embodiments, the shopping assistant apparatus may help a chainstore generate loyalty online and/or offline, by allowing automatedshopping assistance in multiple stores, proactive up sales and crosssales, etc.

In one embodiment of the present invention, the user shopping experiencefor footwear may be substantially enhanced, by applying the followingsteps: Measuring on apparatus 185 a user physical profile, and providinga user standard size as well as modifications for differentshoes/brands; Getting an ID or shopping profile of the customer to thecustomer's mobile computing or communications device; and getting an IDor shopping profile of the customer from apparatus 185 to acommunications cloud.

In a first user case of the present invention, where a user has noprevious user profile, the shopping assistance process may beimplemented as follows: The user generally removes shoes and stands onthe Launch pad or shopping assistant apparatus at entrance to a store orshopping areas. In the current example, a footwear application isdescribed. The apparatus subsequently measures/scans the user's bodyarea, such as feet, and thereafter the apparatus, or cloud network, mayprocess the user data and generate a user shopping avatar. Oncegenerated the avatar is sent to the user's mobile device, running theshopping assistant Application, for example using mail, beacon, SMS, QRcode, IR beam etc. The user may then scan wanted shoes, whereby theapparatus is configured to match and then try on shoes wanted to anavatar to provide best fit. The apparatus may also provide to the userrelated product information, such as availability, colors, sizes,related shoes, rankings etc.

In a second user case of the present invention, where a user hasmultiple devices, the shopping assistance process may be implemented asfollows: The user generally removes shoes and stands on the Launch pador shopping assistant apparatus at entrance to a store or shoppingareas. In the current example, a footwear application is described. Theapparatus subsequently measures/scans the user's body area, such asfeet, and thereafter the apparatus, or cloud network, may process theuser data and generate a user shopping avatar. Once generated the avataris sent to the user's mobile device, running the shopping assistantapplication, for example using mail, beacon, SMS, QR code, IR beam etc.The user may then scan wanted shoes, whereby the apparatus is configuredto match and then try on shoes wanted to an avatar to provide best fit.The apparatus, in the current embodiment, may provide to the user expertor consulting information, thereby functioning at least in part as asales representative. The apparatus may also provide related productinformation, such as availability, colors, sizes, related shoes, andrankings, as well as an option to measure movement/style/weight etc.

In a third user case of the present invention, an augmented shoppingexperience may be delivered, whereby the automated shopping assistanceprocess may incorporate a local shoe scan. In some cases, user data oravatar's may be used to filter in appropriate reviews/comments fromonline world+ social feedback+ rankings, sales information/history,recommendations, up sales, cross sales etc.

Although the present invention has been described in certain specificaspects, many additional modifications and variations would be apparentto those skilled in the art. In particular, any of the various processesdescribed herein can be performed in alternative sequences and/or inparallel (on the same or on different computing devices) in order toachieve similar results in a manner that is more appropriate to therequirements of a specific application. It is therefore to be understoodthat the present invention can be practiced otherwise than specificallydescribed without departing from the scope and spirit of the presentinvention. Thus, embodiments of the present invention should beconsidered in all respects as illustrative and not restrictive. It willbe evident to the annotator skilled in the art to freely combine severalor all of the embodiments discussed here as deemed suitable for aspecific application of the invention. Throughout this disclosure, termslike “advantageous”, “exemplary” or “preferred” indicate elements ordimensions which are particularly suitable (but not essential) to theinvention or an embodiment thereof, and may be modified wherever deemedsuitable by the skilled annotator, except where expressly required.Accordingly, the scope of the invention should be determined not by theembodiments illustrated, but by the appended claims and theirequivalents.

What is claimed is:
 1. A shopping assistant system for shopping using ashopping profile, comprising: a mobile device comprising a processor, amemory, and a camera, wherein the memory stores instructions that, whenexecuted by the processor, cause the mobile device to: display an imageof a standing surface; capture, using the camera, an image of at least apart of a body of a user when the body of the user is located within thestanding surface; and generate a 3D user shopping profile based on theimage of at least the part of the body of the user and further includingat least one: of user physical properties, user behavior data, or userpreference data; a mobile device application configured to apply the 3Duser shopping profile in a store; a shopping assistant server connectedto a shopping assistant database, based in a communications cloud,wherein the shopping assistant server is configured to perform amatchmaking of the 3D user shopping profile to products; and multipleproducts tags configured to allow the user to capture products selectedfrom the shopping assistant database based on the 3D user shoppingprofile to determine a fit of the 3D user shopping profile on one ormore of the captured products, wherein the mobile device application isfurther configured to receive feedback from another user relating to thecaptured products and to perform an updated matchmaking of the 3D usershopping profile to products based on at least the feedback from theother user.
 2. The shopping assistant system of claim 1, furthercomprising one or more image scanners configured to capture at least apart of a body that relates to an anatomical profile of a user, to allowcapture of length, breadth and depth of the part of the body.
 3. Theshopping assistant system of claim 1, wherein the image of the standingsurface includes one or more markings configured to assist in capturingof at least the part of the body of the user.
 4. The shopping assistantsystem of claim 1, wherein the image of the standing surface includesone or more markings configured to assist in positioning of a body partto be scanned.
 5. The shopping assistant system of claim 1, wherein themultiple product tags are scannable.
 6. The shopping assistant system ofclaim 1, further comprising a proximity sensor configured to identify auser when the user enters a selected geographical zone.
 7. The shoppingassistant system of claim 1, further comprising a 3D user shoppingprofile for each of a plurality of users, wherein each 3D user shoppingprofile allows a mobile device user to shop for another user using theother user's shopping profile.
 8. The shopping assistant system of claim1, wherein the mobile device application is further configured toprovide, to a social network, a 3D rendering of one or more of thecaptured products on the 3D user shopping profile, and wherein thefeedback received from the other user is received over the socialnetwork.
 9. The shopping assistant system of claim 1, wherein thefeedback received from the other user is received from a computingdevice in a store associated to the shopping assistance server.
 10. Amethod for in-store shopping enhancement, comprising: detecting a userentering a shopping area, using a proximity sensor associated with ashopping assistant standing surface; identifying the user with a new orknown user profile; capturing of at least a part of a body using one ormore sensors when the user is positioned on the shopping assistantstanding surface; generating a user 3D shopping profile of the userbased on capturing the at least a part of the body; sending the user 3Dshopping profile to a mobile device associated with the user, whereinthe user 3D shopping profile is usable in a shopping assistantapplication; identifying a selected product, based on the user scanninga product tag using an in-store apparatus; providing the user withshopping assistance for the selected product by determining a fit of theuser 3D shopping profile on the selected product, wherein the shoppingassistance includes display the fit of the selected product on the user3D shopping profile; receiving feedback from another user relating tothe selected product; and identifying an updated selected product, basedon at least the feedback from the other user.
 11. The method of claim10, further comprising ordering the selected product using the mobiledevice.
 12. The method of claim 10, further comprising customizing theselected product using the mobile device.
 13. The method of claim 10further comprising ordering a customized product using the mobiledevice.
 14. The method of claim 10, further comprising providing theuser product inventory information.
 15. The method of claim 10, furthercomprising fitting the selected product on a user shopping profileavatar associated with the user 3D shopping profile.
 16. The method ofclaim 10, further comprising sending a fitted user profile avatar to asocial media system for viewing by selected social media users connectedto the user.
 17. The method of claim 10, further comprising providingshopping recommendations based on the user 3D shopping profile and/oruser shopping behavior.
 18. The method of claim 10, further comprisingenhancing the user 3D shopping profile using one or more capturingelements selected from the group consisting of a pressure sensor, imagesensor, laser, and light sensor.
 19. The method of claim 10, furthercomprising adding additional user shopping profiles to the mobiledevice.
 20. The method of claim 10, further comprising converting theuser 3D shopping profile from the in-store apparatus to the mobiledevice.